Skip to content

Conversation

@trentrosenbaum
Copy link
Collaborator

@trentrosenbaum trentrosenbaum commented Apr 10, 2025

The problem with the existing execution of the Acceptance tests is the length of time and understanding the context of failures. Viewing the output of the failure is also problematic due to the volume of information returned.

The following PR separates out the Acceptance Tests into grouped individual steps in the workflow. These are

  • Databases
  • Subscriptions
  • Subscription TLS
  • Essentials Plans
  • Persistence, Modules, Regions and ACLs
  • Cloud Account
  • Transit Payment

Each step allows the execution time to be understood and will execute 6 Acceptance Tests in parallel.
Steps that fail can be re-run if there is an unexpected situation such as network comms or timeout.

@trentrosenbaum trentrosenbaum marked this pull request as ready for review April 15, 2025 13:05
Copy link
Collaborator

@burythehammer burythehammer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Couple of small things, but approved nonetheless


func TestAccResourceRedisCloudSubscriptionPeering_aws(t *testing.T) {

testAccRequiresEnvVar(t, "EXECUTE_TESTS")
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

having now gone through a few of these, it feels like we could extract out these magic strings to some constants just incase you mistype something.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, agreed and I will address this in the next PR.

@trentrosenbaum trentrosenbaum merged commit 49b01a3 into main Apr 15, 2025
12 checks passed
@trentrosenbaum trentrosenbaum deleted the restructure-testacc-execution branch April 15, 2025 14:38
burythehammer pushed a commit that referenced this pull request Nov 10, 2025
* Separates out each group of Acceptance tests into their own steps

* Disbales TestAccResourceRedisCloudCloudAccount_basic
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants